Papers with foundational platform
OptiVerse: A Comprehensive Benchmark towards Optimization Problem Solving (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks focus on Mathematical Programming and Combinatorial Optimization, hindering comprehensive evaluation. |
| Approach: | They propose a benchmarking tool that compares 1,000 curated optimization problems across three difficulty levels. |
| Outcome: | The proposed model improves performance on hard problems while maintaining 27% accuracy. |
MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents (2026.acl-long)
Copied to clipboard
Pengxiang Zhao, Guangyi Liu, Yaozhen Liang, Weiqing He, Zhengxi Lu, WenHao Wang, Yuehao Huang, Yuxiang Chai, Zhaolu Kang, Yaxuan Guo, Hao Wang, Kexin Zhang, Liang Liu, Yong Liu
| Challenge: | Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, but systematic evaluation of GUI–shortcut hybrid agents remains underexplored. |
| Approach: | They propose a benchmark that evaluates GUI-shortcut hybrid agents with a specific focus on the mobile domain. |
| Outcome: | MAS-Bench evaluates agent's ability to generate shortcuts by discovering and creating reusable, low-cost workflows. |